A Latent Cause Theory of Classical Conditioning

نویسندگان

  • Aaron C. Courville
  • James L. McClelland
  • Geoff Gordon
  • Peter Dayan
  • Jay McClelland
چکیده

Classical conditioning experiments probe what animals learn about their environment. This thesis presents an exploration of the latent cause theory of classical conditioning. According to the theory, animals assume that events within their environment are attributable to a latent cause. Learning is interpreted as an attempt to recover the generative model that gave rise to these observed events. In this thesis, the latent cause theory is applied to three distinct areas of classical conditioning, in each case offering a novel account of empirical phenomena. In the first instance, the effects of inference over an uncertain latent cause model structure are explored. A key property of Bayesian structural inference is the tradeoff between the model complexity and data fidelity. Recognizing the equivalence between this tradeoff and the tradeoff between generalization and discrimination found in configural conditioning suggests a statistical account of these phenomena. By considering model simulations of a number of conditioning paradigms (including some not previously viewed as “configural”), behavioral signs that animals employ model complexity tradeoffs are revealed. Next, the consequence of merging latent variable theory with a generative model of change are studied. A model of change describes how the parameters and structure of the latent cause model evolve over time. The resulting non-stationary latent cause model offers a novel perspective on the factors that influence animal judgments regarding environmental change. In particular, the model correctly predicts that the introduction of an unexpected stimulus can spur fast learning. Finally a version of a latent cause model is developed that explicitly encodes a latent timeline to which observed stimuli and reinforcements are associated, preserving their temporal order. In this context, the latent cause model is equivalent to a hiddenMarkovmodel. This model is able to account for a theoretically challenging set of experiments which collectively suggest that animals encode the temporal relationships among stimuli and use this representation to predict impending reinforcement. This thesis offers a unified theoretical framework for classical conditioning. It uses state of the art statistical methods to explore a novel theoretical account of a wide range of empirical phenomena, many of which have otherwise resisted a computational explanation.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Running head: LATENT CAUSE THEORY OF CONDITIONING Exploring a Latent Cause Theory of Classical Conditioning

We frame behavior in classical conditioning experiments as the product of normative statistical inference. According to this theory, animals learn an internal model of their environment from experience. The basic building blocks of this internal model are latent causes—explanatory constructs inferred by the animal that partition observations into coherent clusters. Generalization of conditioned...

متن کامل

Exploring a latent cause theory of classical conditioning.

We frame behavior in classical conditioning experiments as the product of normative statistical inference. According to this theory, animals learn an internal model of their environment from experience. The basic building blocks of this internal model are latent causes-explanatory constructs inferred by the animal that partition observations into coherent clusters. Generalization of conditioned...

متن کامل

Discovering latent causes in reinforcement learning

Effective reinforcement learning hinges on having an appropriate state representation. But where does this representation come from? We argue that the brain discovers state representations by trying to infer the latent causal structure of the task at hand, and assigning each latent cause to a separate state. In this paper, we review several implications of this latent cause framework, with a fo...

متن کامل

The Comparison of Two Models for Evaluation of Pre-internship Comprehensive Test: Classical and Latent Trait

Introduction: Despite the widespread use of pre-internship comprehensive test and its importance in medical students’ assessment, there is a paucity of the studies that can provide a systematic psychometric analysis of the items of this test. Thus, the present study sought to assess March 2011 pre-internship test using classical and latent trait models and compare their results. Methods: In th...

متن کامل

The computational nature of memory modification

Retrieving a memory can modify its influence on subsequent behavior. We develop a computational theory of memory modification, according to which modification of a memory trace occurs through classical associative learning, but which memory trace is eligible for modification depends on a structure learning mechanism that discovers the units of association by segmenting the stream of experience ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006